Optimal Linear Regression on Classi
نویسندگان
چکیده
We consider the combination of the outputs of several clas-siiers trained independently for the same discrimination task. We introduce new results which provide optimal solutions in the case of linear combinations. We compare our solutions to existing ensemble methods and characterize situations where our approach should be preferred.
منابع مشابه
On Optimal Pairwise Linear Classi ers for Normal Distributions: The Two-Dimensional Case
Computing linear classi ers is a very important problem in statistical Pattern Recognition (PR). These classi ers have been investigated by the PR community extensively since they are the ones which are both easy to implement and comprehend. It is well known that when dealing with normally distributed classes, the optimal discriminant function for two-classes is linear only when the covariance ...
متن کاملOptimal designs for testing the functional form of a regression via nonparametric estimation techniques
For the problem of checking linearity in a heteroscedastic nonparametric regression model under a xed design assumption we study maximin designs which maximize the minimum power of a nonparametric test over a broad class of alternatives from the as sumed linear regression model It is demonstrated that the optimal design depends sensi tively on the used estimation technique i e weighted or ordin...
متن کاملFeature Selection and Dualities in Maximum Entropy Discrimination
Incorporating feature selection into a classi cation or regression method often carries a number of advantages. In this paper we formalize feature selection speci cally from a discriminative perspective of improving classi cation/regression accuracy. The feature selection method is developed as an extension to the recently proposed maximum entropy discrimination (MED) framework. We describe MED...
متن کاملProbabilistic Disease Classi cation of Expression-Dependent Proteomic Data from Mass Spectrometry of Human Serum
We have developed an algorithm called Q5 for probabilistic classi cation of healthy versus disease whole serum samples using mass spectrometry. The algorithm employs principal components analysis (PCA) followed by linear discriminant analysis (LDA) on whole spectrum surface-enhanced laser desorption/ionization time of ight (SELDI-TOF) mass spectrometry (MS) data and is demonstrated on four r...
متن کاملEvaluation of hybrid fuzzy regression capability based on comparison with other regression methods
In this paper, the difference between classical regression and fuzzy regression is discussed. In fuzzy regression, nonphase and fuzzy data can be used for modeling. While in classical regression only non-fuzzy data is used. The purpose of the study is to investigate the possibility of regression method, least squares regression based on regression and linear least squares linear regression met...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
دوره شماره
صفحات -
تاریخ انتشار 1997